Storage system, data relocation method thereof, and recording medium that records data relocation program

ABSTRACT

There is a need to improve access speed for a file in a storage system that is provided with multiple storage units having different access speeds. 
     The storage system ( 10 ) includes an access frequency acquiring part ( 14 ) that divides a past constant accessed data acquisition period into multiple unit periods, and obtains an access frequency for file stored in any of the multiple storage units ( 30  and  31 ), a similarity degree calculating part ( 16 ) that obtains, for each file, a similarity degree between the access frequency to the file for each unit period, and the access frequency to every other file for each unit period, a grouping process part ( 17 ) that groups one or more other files having a similarity degree equal to or higher than a predetermined value, in an identical group, and a file relocation part ( 18 ) that places a file belonging to the identical group into a storage unit ( 30 ) having a high access speed, when the file stored in the storage units ( 30  and  31 ) is accessed and there exists any other file within the identical group to which the file belongs.

CROSS REFERENCE TO RELATED APPLICATION

This is a continuation of U.S. application Ser. No. 11/744,907, filedMay 7, 2007 (now U.S Pat. No. 7,853,770). This application relates toand claims priority from Japanese Patent Application No. 2006-237626,filed on Sep. 1, 2006. The entirety of the contents and subject matterof all of the above is incorporated herein by reference.

FIELD OF THE INVENTION

The present invention relates to a storage system that is provided withmultiple storage units having different access speeds, a data relocationmethod thereof, and a data relocation program.

BACKGROUND OF THE INVENTION

In recent years, data volume handled by computers is dramaticallyincreasing, and there is a growing need for a high-capacity storagesystem.

As a high-capacity storage system, there is a hierarchical storagesystem that combines a high-speed low-capacity storage unit having shortrequired access time, but low capacity, and a low-speed high-capacitystorage unit having long required access time but with high capacity. Inthis hierarchical storage system, an appropriate data arrangement issignificant, placing highly accessed data in the high-speed,low-capacity storage unit, and infrequently accessed data in thelow-speed, high-capacity storage unit, so that a user's time requiredfor accessing can be reduced.

Considering the above discussed point, Japanese Patent Laid-openPublication No. H05-12077 (hereinafter, referred to as “Patent Document1”), for instance, discloses the following technique.

Patent Document 1 discloses a technique that obtains access frequencybased on an access history of data that is stored in multiple storageunits each having different performance and capacity, and placesfrequently accessed data into a storage unit having a high accessingspeed, and infrequently accessed data into a storage unit having a lowaccessing speed.

However, in this technique, there is a problem in that when a particulardata item is accessed, there is a high probability that other data itemhaving relevance to this particular data is accessed. Even when theparticular data item is accessed, if this other data item is accessedonly infrequently, it takes a long time for accessing, since the otherdata item is placed in a low-speed storage unit.

In order to solve the above problem, Japanese Patent Laid-openPublication No. H08-263335 (hereinafter, referred to as “Patent Document2”) discloses a technique as follows: When the other data item isaccessed within a certain period of time after the particular data itemis accessed, it is assumed that the particular data item and the otherdata item are belonging to an identical group, and when any of the datawithin the group is accessed, the other data within the group are placedin the high-speed storage unit.

SUMMARY OF THE INVENTION

The technique disclosed by Patent Document 2 is assuredly able to solvethe technical problems included in the art described in PatentDocument 1. However, there are further problems such as the following:For example, if just after accessing a particular data item, other dataitem that has no relevance to this particular data is accidentallyaccessed, this other data item is treated as though it belongs to anidentical group; and even though a data item having a high relevance tothis particular data exists, this data item is not treated as belongingto the identical group, if this data is not accessed after theparticular data is accessed, just before placement of data. Due to theseproblems, appropriate grouping is not performed, resulting in the timefor accessing data being long.

In view of such problems of the conventional art as described above, anobject of the present invention is to provide a storage system thatoptimizes grouping of data and reduces time for accessing data, a datarelocation method thereof, and a data relocation program.

The data relocation method to solve the problems above, in a storagesystem provided with multiple storage units each having a differentaccess speed, executes, an access frequency acquiring process thatdivides a past constant accessed data acquisition period into multipleunit periods, and obtains an access frequency as to each data itemstored in any of the multiple storage units, a similarity degreecalculating process that obtains similarity degrees between an accessfrequency for each unit period of a particular data item among each ofthe data items and the access frequency for each unit period of everyother data item, a grouping process that groups the particular data itemand one or more other data items in an identical group, one or moreother data items having the similarity degree equal to or higher than apredetermined value with regard to the particular data item, and a dataplacing process that places one or more data items belonging to theidentical group into a storage unit having a high access speed among themultiple storage units, when the particular data item is accessed andthere exists any data item within the identical group to which theparticular data item belongs.

Here, the similarity degree calculating process may obtain thesimilarity degree between the data item and every other data item, withrespect to each data item, the grouping process may group one or moreother data items whose similarity degree are equal to or higher than apredetermined value, in the identical group, with respect to each dataitem, and when any among each of the data items is accessed, the dataplacing process may place the data item belonging to the identical groupinto the storage unit having the high access speed, if the identicalgroup includes any data item.

Furthermore, when any of each data item is accessed, this data item maybe assumed to be the particular data item.

In order to solve the problems as described above, a computer readabledata relocation program, that is recorded in a recording medium, is adata relocation program of a storage system provided with multiplestorage units having different access speeds, allows a computer toexecute, an access frequency acquisition step that divides a pastconstant accessed data acquisition period, into multiple unit periods,and obtains an access frequency as to each data item stored in any ofthe multiple storage units, a similarity degree calculating step thatobtains similarity degrees between an access frequency for each unitperiod of a particular data item among each of the data items, and theaccess frequency for each unit period of every other data item, agrouping step that groups the particular data item and one or more otherdata items in an identical group, one or more other data items havingthe similarity degree equal to or higher than a predetermined value withregard to the particular data item, and a data placing step that placesone or more data items belonging to the identical group into a storageunit having a high access speed among the multiple storage units, whenthe particular data item is accessed and there exists any data itemwithin the identical group to which the particular data item belongs.

The storage system to solve the problems as described above is providedwith multiple storage units having different access speeds, and acomputer, and the aforementioned program is installed in the computer.

In the present invention, if a particular data item is accessed andother data item having a high accessing relevancy to this particulardata item exists, this other data is placed in a high-speed storage uniteven though the access frequency of the other data is low. Therefore, itis possible to reduce the access time. Further in the present invention,an access frequency for each data item for each unit period within theaccessed data acquisition period is obtained, and a similarity degreebetween the access frequency of the particular data item for each unitperiod, and the access frequency of the other data item for each unitperiod is also obtained. Therefore, it is possible to group the data sothat the data is not affected by chance. Therefore, also from this pointof view, the access time can be reduced. For instance, in the presentinvention, even though other data item having no relevancy to aparticular data item is accidentally accessed after the particular dataitem is accessed, it is possible to avoid treating this other data asbelonging to an identical group. Furthermore, when there is other dataitem having high relevancy to the particular data, and even though thisother data is not accessed just before placing the data, after theparticular data is accessed, it is possible to treat this other data asbelonging to the identical group. In particular, the present inventionintroduces the concept of degree of grouping, and eliminates chance asfar as possible in the course of obtaining the similarity degree as anindex for grouping. Therefore, very relevant grouping can be performed.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing a storage system as a first embodimentof the present invention;

FIG. 2 is an illustration showing a data structure of a file informationtable as the first embodiment of the present invention;

FIG. 3 is an illustration showing a data structure of an access date andtime table as the first embodiment of the present invention;

FIG. 4 is an illustration showing a data structure of an accessfrequency table as the first embodiment of the present invention;

FIG. 5 is an illustration showing a data structure of a calibratedaccess degree table as the first embodiment of the present invention;

FIG. 6 is an illustration showing a data structure of a file similaritydegree table as the first embodiment of the present invention;

FIG. 7 is an illustration showing a data structure of a file group tableas the first embodiment of the present invention;

FIG. 8 is a flowchart showing an operation of a storage system as thefirst embodiment of the present invention;

FIG. 9 is a flowchart showing details of the process for calculating thecalibrated access degree that is shown in FIG. 8;

FIG. 10 is a flowchart showing details of the process for calculatingthe file similarity degree that is shown in FIG. 8;

FIG. 11 is a flowchart showing an operation of the storage system as thesecond embodiment of the present invention;

FIG. 12 is a flowchart showing details of the process for calculatingthe similarity degree as shown in FIG. 11; and

FIG. 13 is an illustration showing a data structure of the filesimilarity degree table as a modification of the present invention.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, various embodiments of the storage system relating to thepresent invention will be explained with reference to the accompanyingdrawings.

First Embodiment

The first embodiment of the storage system relating to the presentinvention will be explained with reference to FIG. 1 to FIG. 10.

As shown in FIG. 1, the storage system 10 of the present embodiment isprovided with a processor 11 that executes various arithmeticprocessing, a data memory 20 that stores data obtained by the arithmeticprocessing performed by the processor 11, a work memory 27 that is usedin the arithmetic processing performed by the processor 11, a programmemory 28 that stores various programs, a high-speed low-capacitystorage unit 30, a low-speed high-capacity storage unit 31, and aninterface 39 that establishes communication with a network 1. Thisstorage system 10 is connected to a client terminal 2 via the network 1.

The processor 11 in the storage system 10 includes, as its functions, afile information acquisition part 12 that acquires information of a filestored in each of the storage units 30 and 31, an access date and timemanagement part 13 that manages the date and time when the file storedin each of the storage units 30 and 31 is accessed, an access frequencycalculation part 14 that obtains an access frequency to the file duringa past period for acquiring accessed data, an access degree calculationpart 15 that obtains a file access degree as described below, a filesimilarity degree calculation part 16 that obtains a similarity degreebetween the access degree of one file and the access degree of everyother file with respect to each file, a grouping process part 17 thatcategorizes, into one group, multiple files having a high degree ofsimilarity with one another, a file relocation part 18 that places, whenone file in the group is accessed, the other file within an identicalgroup into the high-speed low-capacity storage unit 30, and an accessprocessing part 19 that performs access processing for the files storedin each of the storage units 30 and 31.

The program memory 28 stores various programs including the datarelocation program 29 that the processor 11 executes. The datarelocation program 29 is a program to implement, as functions of theprocessor 11, the access frequency calculation part 14, the accessdegree calculation part 15, the file similarity degree calculation part16, the grouping process part 17, and the file relocation part 18.

The data memory 20 is provided with a file information table 21 thatstores information of a file, which is acquired by the file informationacquisition part 12, an access date and time table 22 that stores accessdate and time when the file is accessed, which is acquired by the accessdate and time managing part 13, an access frequency table 23 that storesan access frequency with respect to each file, which is obtained by theaccess frequency calculation part 14, a calibrated access degree table24 that stores a calibrated access degree described below, which isobtained by the access degree calculation part 15, a file similaritydegree table 25 that stores a similarity degree with respect to eachfile, which is obtained by the file similarity degree calculation part16, and a file group table 26 that stores a file ID with respect to eachgroup.

In the present embodiment, it is assumed that the storage system 10includes each of the storage units 30 and 31 together with the processor11 and the like, in the same enclosure. However, they are notnecessarily accommodated in the same enclosure. In addition, in thepresent embodiment, the storage system 10 and the client terminal 2 areindividual devices. However, there is no problem if the client terminal2 contains the storage system 10, or the storage system 10 contains theclient terminal 2. Here, the high-speed storage unit 30 has a lowcapacity and the low-speed storage unit 31 has a high capacity. However,the capacity size, low or high, does not directly relate to the presentinvention, and the present invention is applicable as long as there aremultiple storage units each having a different access speed.

As mentioned above, the file information table 21 is a table that storesinformation of each file acquired by the file information acquisitionpart 12. As shown in FIG. 2, this file information table 21 includes afile ID field 21 a where a file ID is stored, and a file path field 21 bwhere a path to specify a location of a file with respect to each fileID is stored. By way of example, in the file ID field 21 a, a file ID“1” is stored, and in the file path field 21 b “/fruit/apple.jpg” isstored as a file path corresponding to the file ID “1”. The fileinformation stored in this file information table 21 is continually keptup to date by the file information acquisition part 12.

The access date and time table 22 is a table that stores a date and timewhen each of the files is accessed, which is acquired by the access dateand time managing part 13. As shown in FIG. 3, the access date and timetable 22 includes an access date and time field 22 b which stores thedate and time when the file is accessed, and a file ID field 22 a inwhich a file ID of the file that has been accessed is stored. Forexample, if a file having the file ID “5” is accessed at “2005/10/0109:12:10”, “5” is stored in the file ID field 22 a, and “2005/10/0109:12:10” is stored in the access date and time field 22 b. In thisexample here, only the date and time relating to accessing are stored.However, it is further possible to store attribute information such asindicating whether the access is a write access or a read access. Thisaccess date and time table 22 is updated by the access date and timemanaging part 13, every time the access processing part 19 accesses afile.

The access frequency table 23 is a table that stores the number of timesof access, i.e., access frequency, with respect to each file during theaccessed data acquisition period, which is obtained by the accessfrequency calculation part 14. The accessed data acquisition period is aperiod necessary for data relocation described below, and it ispredetermined by a user. Here, as shown in FIG. 4, the accessed dataacquisition period is assumed as being one week from 2005/10/1 to2005/10/7 (i.e., Oct. 1 to 7, 2005). This accessed data acquisitionperiod may be divided into multiple unit periods, which arepredetermined by the user. In this particular example, this unit periodis one day. The access frequency table 23 includes a file ID field 23 ato store a file ID of each file stored in each of the storage units 30and 31, an access frequency field 23 b to store the access frequency foreach unit period during the accessed data acquisition period, withrespect to each file ID, and a total field 23 c to store a total accessfrequency during the accessed data acquisition period with respect toeach file ID. This particular example illustrates that “1” is stored inthe file ID field 23 a and the access frequency field 23 b associatedwith this file ID “1” stores 0 times for “2005/10/1”, 0 times for“10/2”, three times for “10/3”, five times for “10/4”, two times for“10/5”, one time for “10/6”, and 0 times for “10/7”. It is to be notedthat in this example, the access frequency is stored withoutdistinguishing between write access and read access. However, it ispossible to differentiate the write access and the read access when eachaccess frequency is stored.

The calibrated access degree table 24 is a table to store a calibratedaccess degree that is obtained by the access degree calculation part 15by using the access frequency, for each unit period with respect to eachfile ID. Definitions of the calibrated access degree, the access degreeto obtain the calibrated access degree, and a calculation method thereofwill be described in detail below. Basically, both the access degree andthe calibrated access degree are values indicating a degree of accessfrequency of the file during a unit period, relative to the total accessfrequency of the file during the accessed data acquisition period.Therefore, if the access degree or the calibrated access degree is highfor a certain file during a constant unit period, this indicates thatthe number of times of access for this file is large during this unitperiod. This calibrated access degree table 24 includes a file ID field24 a to store the entire file IDs stored in the file ID field 23 a ofthe access frequency table 23, and a calibrated access degree field 24 bthat stores a calibrated access degree for each unit period during theaccessed data acquisition period with respect to each file ID. Thisparticular example illustrates that “1” is stored in the file ID field24 a, and in the calibrated access degree fields 24 b associated withthis file ID “1”, the calibrated access degrees are respectively stored,i.e., “0” for “2005/10/1”, “0” for “2005/10/2”, “0.68” for “10/3”,“0.91” for “10/4”, “0.36” for “10/5”, “0.18” for “10/6”, and “0” for“10/7”.

The file similarity degree table 25 is a table where the file similaritydegree calculation part 16 stores a similarity degree indicating asimilarity degree between the access frequency for one file within theunit period and the access frequency for other files within the unitperiod, with respect to each file ID. Definitions of the similaritydegree and a calculation method thereof will be described in detailbelow. The higher the value is, the higher the possibility is that thetwo files are accessed within an identical unit period. The filesimilarity degree table 25 includes a file ID field 25 a to store allthe file IDs stored in the file ID field 23 a of the access frequencytable 23, and a similarity degree field 25 b that stores a similaritydegree relative to another file, with respect to each file ID and theother file ID. This particular example illustrates that “1” is stored inthe file ID field 25 a, and, in the similarity degree fields 25 bassociated with the file ID “1”, the similarity degrees are respectivelystored, i.e., a similarity degree “0.43” for a file having a file ID“2”, a similarity degree “1.15” for a file having a file ID “3”, asimilarity degree “0.36” for a file having a file ID “4”, a similaritydegree “0.66” for a file having a file ID “5”, a similarity degree “0”for a file having a file ID “6”, a similarity degree “0” for a filehaving a file ID “7”, a similarity degree “0.42” for a file having afile ID “8”, a similarity degree “0.30” for a file having a file ID “9”,and a similarity degree “0.53” for a file having a file ID “10”.

The file group table 26 is a table where the grouping process part 17stores, with respect to each file ID, a second file ID that is assumedas belonging to a group that is the same as the file having the file ID.The group processing method will be described below. As shown in FIG. 7,the file group table 26 includes a file ID field 26 a storing all thefile IDs stored in the file ID field 23 a of the access frequency table23, and a field 26 b of file IDs included in the same group storing afile ID belonging to the same group as the file, for each file ID. Thisparticular example illustrates that “1” is stored in the file ID field26 a, and “3” is stored in the field of file IDs included in the samegroup 26 b, which is associated with the filed ID “1”. In other words,this example indicates that the file having the file ID “1” and the filehaving the file ID “3” belong to the same group. Therefore, “3” isstored in the file ID field 26 a, and, clearly, “1” is stored in theassociated field of file IDs included in the same group 26 b. However,this is not the case if this grouping is performed while distinguishingbetween reading access and writing access, as described below.

Next, with reference to the flowchart shown in FIG. 8, operations of thestorage system 10 according to the present embodiment will be explained.

Firstly, the access frequency calculation part 14 determines whether ornot the latest unit period is finished (S10). If the latest unit periodis not finished yet, that is, it is still within the unit period, theprocess in step 80 is carried out. If the latest unit period is alreadyfinished, the access frequency calculation part 14 sets a new unitperiod and a new accessed data acquisition period (S20).

By way of example, if the current date is Oct. 7, 2005, the accesseddata acquisition period at this date is one week, from Sep. 30, 2005 toOct. 6, 2005. In the case above, the access frequency calculation part14 determines that the latest unit period is October 7 and determineswhether or not this day is finished (S10). If this day is finished, theaccess frequency calculation part 14 sets this day, i.e., October 7, asa new unit period of the accessed data acquisition period, as well aschanging the setting of the accessed data acquisition period to oneweek, from the Oct. 1, 2005 to Oct. 7, 2005. According to this change ofsettings, the access frequency calculation part 14 renews the date ofeach unit period in the access frequency table 23 (FIG. 4). In theexample here, it is assumed that the accessed data acquisition period isone week and the unit period is one day. However, the present inventionis not limited to these settings. In addition, in the example here, itis assumed that the new accessed data acquisition period is the mostrecent one week. However, a user may decide, as appropriate, a starttime and an end time of the new accessed data acquisition period.Therefore, depending on the settings by the user, the unit period neednot necessarily be the latest, in deciding whether or not the unitperiod of step 10 is finished.

Subsequently, the access frequency calculation part 14 refers to theaccess date and time table 22 and obtains the access frequency of eachfile with respect to each unit period within the accessed dataacquisition period, and stores this access frequency in the accessfrequency table 23 (S30). In this example here, the access frequencycalculation part 14 obtains only the access frequency during a unitperiod newly set in step 20, and as for the other unit periods duringthe accessed data acquisition period, the data during the unit periodalready calculated is used as it is. Consequently, as shown in FIG. 4,the access frequency table 23 stores a frequency of each file withrespect to each unit period during the accessed data acquisition periodcorresponding to one week from Oct. 1, 2005 to Oct. 7, 2005.

When the access frequency table 23 is updated by the access frequencycalculation part 14, the access degree calculation part 15 obtains acalibrated access degree, and stores this value in the calibrated accessdegree table 24 (S40).

Here, with reference to the flowchart as shown in FIG. 9, details of thecalibrated access degree calculation process (S40) will be explained,which is performed by the access degree calculation part 15.

The access degree calculation part 15 firstly determines whether or notthe all the unit periods set in the access frequency table 23 areselected (S41). If all the unit periods are selected, the processingcontinues to step 45. If the entire unit periods are not selected, anon-selected unit period t is selected (S42), and the access degreecalculation part 15 obtains the number of files that have been accessedduring the unit period t, in other words, access frequency N(t) of allthe files (S43). Subsequently, a grouping degree Y(t) (=N/N(t)) iscalculated, which is a ratio between the number of all the files Nstored in the file information table, and the access frequency N(t) toall the files within the unit period t (S44). For example, the number ofall the files N is 10 (ten) having the file IDs “1” to “10”, and 5(five) files are accessed during the unit period of October 1, which isthe access frequency N (10/1) to all the files. Therefore, the groupingdegree Y (10/1) of the unit period of October 1 is equal to two (=10/5).In addition, the grouping degree in the unit period of October 3 (10/3)is equal to 2.5 (=10/4). The grouping degree Y(t) is a value having arole of assigning weights to the access degree described below, and whenthe access frequency N(t) within the unit period t becomes larger, thevalue of the grouping degree Y(t) becomes smaller. The significance ofthe grouping degree will be explained later.

When the grouping degree Y(t) for a constant unit period t iscalculated, the processing returns to step 41, and again it isdetermined whether or not all the unit periods have been selected. Ifall the unit periods are selected, it is determined whether or not allthe files stored in the access frequency table 23 have been selected(S45). If all the files are selected, the process for calculating thecalibrated access degree (S40) is terminated. If all the files have notbeen selected, file a, which has not been selected yet, is selected(S46). Then, the total access frequency C(a) to this file a during theaccessed data acquisition period is obtained from the access frequencytable 23 (S47). For example, the total access frequency C(1) to the filehaving the file ID “1” is “11” according to the access frequency table23 (FIG. 4).

Subsequently, the access frequency calculation part 14 determineswhether or not all the unit periods within the accessed data acquisitionperiod have already been selected (S48), and if they have already beenselected, the processing returns to step 45. Otherwise, the unit periodt that has not been selected yet is selected (S49). Then, the accessfrequency C to the file a, during the unit period t(a, t), is obtainedfrom the access frequency table 23 (S50). Thereafter, the access degreeX(a, t) (=C(a, t)/C(a)) is obtained, which is a ratio of the accessfrequency C(a, t) to the file a during the unit period t, relative tothe total access frequency C(a) to the file a during the accessed dataacquisition period (S51). For example, C(1, 10/3) is “3”, which is theaccess frequency to the file “1” during the unit period of October 3,according to the access frequency table 23 (FIG. 4). The total accessfrequency C(1) to the file “1” is “11” as described above. Therefore,X(1, 10/3) is 0.27 (=3/11), which is the access degree of the file “1”during the unit period of October 3.

Next, the access degree X(a, t) to the file a during the unit period tis multiplied by the grouping degree Y(t) during the same unit period,which is obtained in step 44, and a calibrated access degree W(a, t) iscalculated. Then, this calibrated access degree is stored in acorresponding field in the calibrated access degree table 24 (FIG. 5)(S52). For example, the access degree X(1, 10/3) at the unit period ofOctober 3 for the file “1 ” is “0.27 ” as described above, and thegrouping degree Y(10/3) at the unit period of October 3 is “2.5” asdescribed above. Therefore, the calibrated access degree W(1, 10/3) atthe unit period of October 3 for the file “1” is equal to 0.68(=0.27×2.5).

When the calibrated access degree W(a, t) for the file a during the unitperiod t is obtained, the processing returns to step 48 again, anddetermines whether or not all the unit periods have been selected withregard to the file a. Here, if all the unit periods have already beenselected with regard to the file a, and the calibrated access degreeW(a, t) with respect to each unit period has already been obtained as tothe file a, the processing returns to step 45, and again, it isdetermined whether or not all the files have been selected. At thistiming, if all the files have already been selected, and a calibratedaccess degree for each of all the unit periods has been obtained withrespect to each file, the process of calculating the calibrated accessdegree (S40) is terminated.

Here, an explanation will be made regarding the access degree X(a, t),the calibrated access degree W(a, t), and the grouping degree Y(t).

Basically, the access degree X(a, t) of the file a is a relative valueof the frequency to access to the file a during a particular unit periodt, which is relative to the access frequency to the file a during allthe unit periods within the accessed data acquisition period. Therefore,if the access degree X(a, t) to the file a during the particular unitperiod t is high, it means that the access frequency to the file aduring this particular unit period t is higher compared to the otherunit periods. If another file b has a high access degree X(b, t) duringthis particular unit period t, both access frequencies to the file a andthe file b are higher during this unit period t, relative to the otherunit periods. Therefore, it is possible to determine that there is ahigh similarity between the access frequency to the file a and theaccess frequency to the file b, and when grouping files having a highsimilarity in access frequency, both the file a and file b are treatedas belonging to the same group. It is to be noted here that if theaccess frequency to other multiple files during this unit period t isalso extremely high, both the file a and the file b are accessed becausethere is a high possibility that both files are accidentally accessedduring this unit period t, not because there is a certain relationshipbetween the file a and the file b.

In the present embodiment, if the total access frequency N(t) to eachfile during a particular unit period t is high, the similarity betweenboth files a and b is lowered. On the other hand, if the total accessfrequency to each file during the particular unit period t is low, aconcept of grouping degree Y(t) (=N/N(t)) is introduced so as to enhancethe similarity between the files a and b, and by using the groupingdegree, the similarity between the files a and b is corrected. In otherwords, as described above, if the total access frequency N(t) to all thefiles during a particular unit period t becomes higher, the groupingdegree Y(t) conversely becomes lower. Therefore, in the presentembodiment, the access degree X(a, t) during a particular time ismultiplied by the grouping degree Y(t) as a weighting, and the obtainedvalue is assumed as a calibrated access degree W(a, t). The similarityof the access frequency with other files is considered, using thiscalibrated access degree W(a, t), to eliminate, as much as possible,chance increasing of similarity.

When the process of calculating the calibrated access degree (S40) isterminated, as shown in the flowchart of FIG. 8, the file similaritydegree calculation part 16 obtains a similarity degree of the accessfrequency between files (S60), by using the calibrated access degreeobtained by the process of calculating the calibrated access degree(S40).

As indicated by the flowchart in FIG. 10, in the process of calculatingthe file similarity degree (S60), firstly it is determined whether ornot all the files stored in the calibrated access degree table 24 havebeen selected (S61). If all the files have already been selected, theprocess of calculating the file similarity degree (S60) is terminated.If all the files have not been selected, a file a that has not beenselected yet is selected (S62).

Next, the file similarity degree calculation part 16 determines whetheror not there exists in the calibrated access degree table 24, a filehaving an ID larger than the file ID of the file a (S63). If there is nofile having a larger ID number, the processing returns to step 61. Ifthere is a file having a larger ID number, all the larger IDs areextracted, and a set F of files having the larger IDs is formed (S64).Then, it is determined whether or not all the files within the set Fhave already been selected (S65). If all the files have already beenselected, the process returns to S61. If all the files have not beenselected yet, a non-selected file b within the set F is selected (S66).

When the file similarity degree calculation part 16 selects thenon-selected file b within the set F, it is determined whether or notthe entire unit periods within the accessed data acquisition period havebeen selected (S67). If all the unit periods have already been selected,the process returns to step 65, and if all the unit periods have notbeen selected yet, a non-selected unit period t within the accessed dataacquisition period is selected (S68). Next, from the calibrated accessdegree table 24, the calibrated access degree W(a, t) of the file a andthe calibrated access degree W(b, t) of the file b during this unitperiod t are extracted, and these are multiplied by each other, and anobtained value is set as a temporary similarity degree R(a, b) (S69).When the temporary similarity degree is obtained, the process returns tostep 67. In step 68, a non-selected unit period is selected, and thecalibrated access degree of the file a and the calibrated access degreeof the file b during this unit period are multiplied by each other, andto this obtained value, the temporary similarity degree R(a, b)previously obtained is added (S69). Again, the process returns to step67, and the step 67 to step 69 are repeated until selection of all theunit periods is completed. In other words, a value obtained bymultiplying the calibrated access degree of the file a and thecalibrated access degree of the file b with respect to each unit periodwithin the accessed data acquisition period is summed, and an obtainedtotal is set as a similarity degree R(a, b) between the file a and thefile b. This similarity degree R(a, b) is stored in a correspondingfield of the file similarity degree table 25 (FIG. 6). For example, thesimilarity degree R(1, 2) between the file “1” and the file “2” in thecalibrated access degree table 24 as shown in FIG. 5 is expressed as thefollowing.

Similarity degree R(1, 2)=0×0.5 (for October 1)+0×1.25 (for October2)+0.68×0.63 (for October 3)+0.91×0 (for October 4)+0.36×0 (for October5)+0.18×0 (for October 6)+0×0 (for October 7)=0.43

This similarity degree R(1, 2)=0.43 is stored in the field of similaritydegree of the file “2” being associated with the file “1”, in the filesimilarity degree table 25 as shown in FIG. 6.

When the similarity R(a, b) between the file a and file b is obtained,the process returns to step 65, and in step 66, a non-selected file cwithin the set F is selected. Then, a similarity degree R(a, c) betweenthe file a and the file c is obtained in the process from step 67 tostep 69. If non-selected file does not exist any more in the set F(S65), the process returns to step 61. Finally, when the similaritydegree is obtained with regard to all combinations of files as to allthe files stored in the calibrated access degree table 24, this processof calculating the file similarity degree (S60) is terminated.

When the process of calculating the file similarity degree (S60) isterminated, as shown in the flowchart of FIG. 8, the grouping processpart 17 puts more than one file into some groups (S70), by using thesimilarity degree obtained in the process of calculating the filesimilarity degree (S60). Here, in the file similarity degree table 25(FIG. 6), two files having the similarity degree equal to 1 or moretherebetween are determined as having a high access relevance ratiobetween the files, and they are treated as belonging to the same group.For example, the similarity degree between the file “1” and the file “3”is “1.15” according to the file similarity degree table 25. Therefore,both files are treated as being belonging to the same group and thisresult is stored in the file group table 26 (FIG. 7).

When the process of the grouping process (S70) as described above isterminated, the file relocation part 18 and the access processing part19 determine whether or not there is access to any of the files (S80).If there is access to any of the files, the access processing part 19performs the access processing for this file. In addition, the filerelocation part 18 refers to the file group table 26, and determineswhether or not there is a file belonging to the same group with thisaccessed file (S90). If there is a file belonging to the same group withthis file and the files in the group are placed in the low-speedhigh-capacity storage unit 31, those files within the group are placedin the high-speed low-capacity storage unit 30. If those files withinthe group are already placed in the high-speed low-capacity storage unit30, the location of the files is kept the same (S100). In the relocationprocess, if the file being accessed is placed in the low-speedhigh-capacity storage unit 31, this file may also be placed in thehigh-speed low-capacity storage unit 30.

When this data relocation process (S100) is terminated, and furthermorewhen a negative judgment is made in the previous judgments (S80, 90),the process returns to step 10, and steps 80, 90, 100, and 10 arerepeated until the latest unit period is over.

In the present embodiment as described above, if there is access to acertain file and there is a second file that has a high access relevancewith this file, this second file is placed in the high-speed storageunit 30 even through the access frequency to this second file is low,and therefore, accessing time can be reduced. In the present embodiment,an access frequency with respect to each file for each unit periodwithin the accessed data acquisition period is obtained, and asimilarity degree between the access frequency for every unit period ofa certain file and the access frequency for every unit period of anotherfile is obtained. Therefore, it is possible to perform grouping thatdoes not depend much on chance. Also from this point of view, it ispossible to say that accessing time can be reduced. For example, in thepresent embodiment, even though a second file is accessed after theparticular file is accessed, the second file not being relevant to aparticular file, it is possible to avoid this second file being treatedas belonging to the same group. Even if there is a second file highlyrelevant to the particular file, and this second file is not accessedafter the particular file is accessed, just before the placement of thefile, it is possible to treat this second file as belonging to the samegroup. Especially, in the present embodiment, a concept of groupingdegree Y(t) is introduced and chance is eliminated as much as possiblein the course of obtaining the similarity degree as an index of thegrouping. Therefore, very relevant grouping can be performed.

In the description above, relocation of a file from the low-speedstorage unit 31 to the high-speed storage unit 30 has been explained indetail. However, if only the relocation from the low-speed storage unit31 to the high-speed storage unit 30 is performed, relocation of filesin the high-speed storage unit 30 may become no longer possible at somefuture time. Therefore, it is required in the present embodiment thatthe relocation of a file from the high-speed storage unit 30 to thelow-speed storage unit 31 be performed when a certain condition issatisfied. In order to implement the above processing, a method may beconsidered in which, for example, for a file having an access frequencyequal to or less than a predetermined value, within the accessed dataacquisition period, after the end of the file grouping process (S70) asshown in FIG. 8, the file is relocated to the low-speed storage unit 31,in the course of waiting for access to the file (S80).

Here, a load on the storage system relating to the relocation process asdescribed above will be studied.

If the total number of files is assumed as N, and the number of unitperiods included in the accessed data acquisition period is assumed asS, the number of arithmetical operations required for the processing isroughly calculated as follows.

In order to calculate C(a), the number of access times is counted foreach unit period. Therefore, it is necessary that the number ofarithmetical operation times be S. Since C(a, t) is divided by C(a) inorder to calculate X(a, t), it is necessary that the number ofarithmetical operation times be (S+1). In order to calculate X(a, t) ofall the files for all the unit periods within the accessed dataacquisition period, this calculation is performed for all the files andfor all the unit periods. Therefore, it is necessary that the number ofarithmetical operation times be (S+1)×S×N.

Since the information concerning whether a file is accessed or not iscounted for each file, in order to calculate N(t), it is necessary thatthe number of arithmetical operation times be N. Since N(t) is dividedby N in order to calculate Y(t), it is necessary that the number ofarithmetical operation times be (N+1). In order to calculate Y(t) forall the unit periods within the accessed data acquisition period, thiscalculation is performed for all the unit periods. Therefore, it isnecessary that the number of arithmetical operation times be (N+1)×S.

In order to calculate W(a, t) of all the files for all the unit periodswithin the accessed data acquisition period, X(a, t) is required to bedivided by Y(t) for all the files and for all the unit periods.Therefore, it is necessary that the number of arithmetical operationtimes be (S+1)×S×N+(N+1)×S+S×N.

In order to calculate R(a, b) of combinations of all the files,multiplication and addition for all the unit periods are performed forN×(N−1)/2 times, which is the number of combinations of all the files.Therefore, it is necessary that the number of arithmetical operationtimes be (S+S)×N×(N−1)/2.

In order to reduce the number of calculation times, the similaritydegree may be calculated only for an accessed file after the file accessis performed, as described in the following second embodiment, withoutcalculating in advance the similarity degree of each combination of allthe files. In this case, to calculate the similarity degree of the filebeing accessed, the multiplication and addition for all the unit periodsare required to be performed for (N−1) times, which is the number offiles excluding the accessed file. Therefore, it is necessary that thenumber of arithmetical operation times be (S+S)×(N−1).

In the meantime, it is known that a Pentium (trademark)/2.8 GHz, whichis a generally available CPU, has a computing performance of around 5.6GFLOPS.

Here, it is assumed that by using a computer of 10 GFLOPS, theprocessing as described above is carried out under the condition that atotal number of files is “one million”, designated acquisition period is“one year”, and an acquisition unit period is “one day”. In this case, arough calculation as follows can be done: According to the abovedescription, the computing number of times required for obtaining W(a,t) of all the files is equal to 134×10⁹, and the time for computing isequal to 13.4 seconds. When the similarity degree of each combination ofall the files is calculated in advance, the required number ofcomputations is equal to 365067×10⁹, and the time for computing is equalto 36506.7 seconds≈10 hours. When only the similarity degree is obtainedas to an accessed file after the file accessing is performed, therequired number of computations is equal to 0.73×10⁹, and the time forcomputation is equal to 0.073 seconds.

According to the results as described above, the relocation method ofthe present embodiment is considered to be sufficiently feasible.

Second Embodiment

The second embodiment of the storage system according to the presentinvention will be explained with reference to FIG. 11 and FIG. 12.

The storage system according to the present embodiment has a functionalconfiguration that is basically the same as the functional configurationof the first embodiment as shown in FIG. 1. However, the order ofcarrying out the processing in each of the functional configurations 12to 19 is different from the first embodiment.

Specifically as shown in FIG. 11, in the present embodiment, after anyone of the files is accessed (S80 a), a similarity degree between thisaccessed file a and another file is obtained (S60 a). According to thissimilarity degree, a file belonging to the same group as this file a isdetermined (S70 a). In other words, in the present embodiment, a processto determine the end of unit period (S10), a process to set a newaccessed data acquisition period (S20), a process to calculate an accessfrequency (S30), and a process to calculate a calibrated access degree(S40) are the same as the first embodiment. However, in the presentembodiment, at the point of time when the process to calculate thecalibrated access degree (S40) is finished, a process to determinewhether or not there is an access (S80 a) is performed, and thereafter,as described above, a process to calculate a similarity degree betweenthe access file a and a second file (S60 a), and a process to group thefile a (S70 a) are performed. Then, a process to determine whether ornot there is a file belonging to an identical group (S90 a) and aprocess to relocate the data (S100) are performed.

The similarity degree calculation process (S60 a) of the presentembodiment does not need to obtain a similarity degree between each fileand the other file for all the files. Therefore, as shown in theflowchart of FIG. 12, unlike the similarity degree calculating process(S60) of the first embodiment, a set F of the files excluding theaccessed file a is configured immediately (S64 a). Thereafter, eachprocess from step 65 to step 69 is carried out, similar to thesimilarity degree calculation process (S60) of the first embodiment.

As thus described, unlike the first embodiment, in the presentembodiment, the similarity degree calculating process (S60) and thegrouping process (S70) are not carried out for all the files, and thesimilarity degree calculation process (S60 a) and the grouping process(S70 a) are carried out only for the file that has been accessed.Therefore, it is possible to reduce the load placed by the relocationprocess in the storage system.

Various Modifications

In the above examples, when a similarity degree between the files isobtained, an access degree and a calibrated access degree of this fileare obtained according to the access frequency of the file, and by usingthis calibrated access degree, a similarity degree is obtained. However,there is another method that is capable of directly obtaining thesimilarity degree based on the access frequency, without acquiring theaccess degree and the calibrated access degree. By way of example, whena similarity degree between a file “1” and a file “2” is obtained, theaccess frequency of the file “1” and the access frequency of the file“2” are multiplied with respect to each unit period, and a valueobtained by calculating the sum of those multiplied values may beassumed as the similarity degree between the file “1” and the file “2”.In other words, the similarity degree R(1, 2) between the file “1” andthe file “2” may be obtained as in the following.

Similarity degree R(1,2)=0×1 (for October 1)+0×2 (for October 2)+3×1(for October 3)+5×0 (for October 4)+2×0 (for October 5)+1×0 (for October6)+0×0 (for October 7)=3

In the case above, the file similarity degree table is as shown in FIG.13. If it is assumed here that the files having a similarity degree of15 or more between two files (underlined in the figure) have high accessrelevance between the files, and belong to the same group, a result ofthe grouping process may be the same as the first embodiment.

If the similarity degree is obtained as thus described, the calculationbecomes extremely simple. Therefore, a load placed by the datarelocation process in the storage system can be reduced. However, inthis modified example, the concept of grouping degree to eliminatechance as much as possible is not utilized. Therefore, there may be morepossibility of chance in the grouping, relative to the first embodiment.

However, there may be cases in which too large a number of files exist,which there have a high possibility of being accessed next after thefile a is accessed, and relocation of those files to the high-speedmemory 30 is difficult. There are some countermeasures to deal with thesituation above, such as a method to change grouping threshold, a methodto select from the upper rank of access relevance degree, by the numberof files or by the total size of file, and a method to relocate only awrite file that has a relatively long access time, out of two accessingtypes, reading and writing.

Among the above-mentioned methods, the method to relocate only the writefile requires adding information as an access attribute indicatingwhether or not the access is for reading or writing, to the access dateand time table 22 shown in FIG. 3. In addition, a field of accessfrequency of the access frequency table 23 is required to include acolumn to indicate whether the access is a read access or a writeaccess. By way of example, when the file a receives an access (read orwrite), in order to relocate the file b having a high possibility ofwrite access, the processing of S67, S68, and S69 as shown in FIG. 10 isexecuted by using the calibrated access degree W(a, t) of the file a andthe calibrated write access degree Ww(b, t) of the file b, therebyobtaining the similarity degree between the file a and the file b. Here,the calibrated write access degree Ww(b, t) is defined as follows.Ww(b, t)=Xw(b, t)·Y(t)=[Cw(b, t)/C(b)]·Y(t)

-   -   Xw(b, t): Write access degree during unit period t    -   Cw(b, t): Write access frequency to file b during unit period t

In other words, the calibrated write access degree Ww(b, t) of the fileb is obtained by multiplying the write access degree Xw(b, t) to thefile b, by the grouping degree Y(t) during the unit period t.

In the above example, relocation using the file as a unit has beenexplained. Besides the file unit, relocation may be performed for anydata unit, as long as the data unit allows the acquisition of accessfrequency and transferring between storage units, such as mail, afolder, a volume, a table of database, a record, or a field.

In the above example, two types of storage units 30 and 31, high-speedaccess and low-speed access speed, are provided. However, the presentinvention is not limited to this configuration, and it is applicable tocases where three or more types of access speeds are available. For suchcases, if there is a relationship between the file a and the file b, andthe file a is accessed, it is possible to consider a method thatrelocates the file b to the highest speed storage unit. As analternative method, for example, two thresholds are set as thresholds ofsimilarity degree for grouping. A combination of files having asimilarity degree equal to or more than the first threshold (>secondthreshold) is configured as belonging to a group of high relevancy. Acombination of files having the similarity degree less than the firstthreshold and equal to or more than the second threshold is configuredas belonging to a group of medium relevancy. When one file in the groupof high relevancy is accessed, the file within this group may be placedin the highest speed storage unit . When one file in the group of mediumrelevancy is accessed, the file within this group may be placed in thestorage unit having the second higher speed.

1. A data relocation method in a storage system provided with multiplestorage units having different access speeds, the data relocation methodcomprising: a number of access to data item during a unit periodacquiring process that divides a past constant accessed data acquisitionperiod into multiple unit periods, and obtains a number of access todata item during the unit period for each data item stored in any of themultiple storage units; a similarity degree computing process thatmultiplies the number of accesses for each unit period of a particulardata item, by the number of accesses during a corresponding unit periodof an other data item, and sums a result of the multiplication for eachunit period, as a similarity degree between the particular data item andthe other data item, in order to show similarity of access tendencybetween data items during a past constant period; a grouping processthat groups the particular data item and one or more other data itemshaving the similarity degree equal to or higher than a predeterminedgrouping value, as a group of data items indicating a similar tendencyof access; a data migrating process that, when the group of data itemscontains less items than a predetermined data items value, migrates oneor more data items belonging to the group of data items into a storageunit having a high access speed among the multiple storage units, whenat least one of data items belonging to the identical group and storedin a storage unit having a low access speed is accessed; and, a groupingvalue changing process that, when the group of data items contains itemsof at least the predetermined data items value, changes thepredetermined number of data items value and implements the datarelocation method again.
 2. The data relocation method according toclaim 1, wherein the grouping value changing process raises thepredetermined data items value and implements the data relocation methodagain.
 3. The data relocation method according to claim 1, the datarelocation method further comprising: an access relevance degree rankingprocess of assigning an access relevance degree to each data item of thedata items; wherein the data migrating process migrates data items ofthe one or more data items, beginning from an upper rank of accessrelevance degree of the data items.
 4. The data relocation methodaccording to claim 1, the data relocation method further comprising: adata item sizing process of determining a size of each data item of thedata items; wherein the data migrating process migrates data items ofthe one or more data items, according to sizes of the data items.
 5. Thedata relocation method according to claim 1, the data relocation methodfurther comprising: an access-type determining process of determiningwhether an access of a data item is a read-type access or a write-typeaccess; wherein the data migrating process migrates data items of theone or more data items, only for data items concerning the write-typeaccess.
 6. A non-transitory computer-readable recording medium thatrecords a data relocation program of a storage system provided withmultiple storage units having different access speeds, which allows acomputer to execute: a number of access to data item during a unitperiod acquiring process that divides a past constant accessed dataacquisition period into multiple unit periods, and obtains a number ofaccess to data item during the unit period for each data item stored inany of the multiple storage units; a similarity degree computing processthat multiplies the number of accesses for each unit period of aparticular data item, by the number of accesses during a correspondingunit period of an other data item, and sums a result of themultiplication for each unit period, as a similarity degree between theparticular data item and the other data item, in order to showsimilarity of access tendency between data items during a past constantperiod; a grouping process that groups the particular data item and oneor more other data items having the similarity degree equal to or higherthan a predetermined grouping value, as a group of data items indicatinga similar tendency of access; a data migrating process that, when thegroup of data items contains less items than a predetermined data itemsvalue, migrates one or more data items belonging to the group of dataitems into a storage unit having a high access speed among the multiplestorage units, when at least one of data items belonging to theidentical group and stored in a storage unit having a low access speedis accessed; and, a grouping value changing process that, when the groupof data items contains items of at least the predetermined data itemsvalue, changes the predetermined number of data items value andimplements the data relocation program again.
 7. The recording mediumaccording to claim 6, wherein the grouping value changing process raisesthe predetermined data items value and implements the data relocationmethod again.
 8. The recording medium according to claim 6, which allowsthe computer to further execute: an access relevance degree rankingprocess of assigning an access relevance degree to each data item of thedata items; wherein the data migrating process migrates data items ofthe one or more data items, beginning from an upper rank of accessrelevance degree of the data items.
 9. The recording medium according toclaim 6, which allows the computer to further execute: a data itemsizing process of determining a size of each data item of the dataitems; wherein the data migrating process migrates data items of the oneor more data items, according to sizes of the data items.
 10. Therecording medium according to claim 6, which allows the computer tofurther execute: an access-type determining process of determiningwhether an access of a data item is a read-type access or a write-typeaccess; wherein the data migrating process migrates data items of theone or more data items, only for data items concerning the write-typeaccess.
 11. A storage system provided with multiple storage units eachhaving a different access speed, where the storage system is effected atleast in part by a processor and a memory, and is adapted to performprocesses of: a number of access to data item during a unit periodacquiring process that divides a past constant accessed data acquisitionperiod into multiple unit periods, and obtains a number of access todata item during the unit period for each data item stored in any of themultiple storage units; a similarity degree computing process thatmultiplies the number of accesses for each unit period of a particulardata item, by the number of accesses during a corresponding unit periodof an other data item, and sums a result of the multiplication for eachunit period, as a similarity degree between the particular data item andthe other data item, in order to show similarity of access tendencybetween data items during a past constant period; a grouping processthat groups the particular data item and one or more other data itemshaving the similarity degree equal to or higher than a predeterminedgrouping value, as a group of data items indicating a similar tendencyof access; a data migrating process that, when the group of data itemscontains less items than a predetermined data items value, migrates oneor more data items belonging to the group of data items into a storageunit having a high access speed among the multiple storage units, whenat least one of data items belonging to the identical group and storedin a storage unit having a low access speed is accessed; and, a groupingvalue changing process that, when the group of data items contains itemsof at least the predetermined data items value, changes thepredetermined number of data items value and performs the processesagain.
 12. The storage system according to claim 11, wherein thegrouping value changing process raises the predetermined data itemsvalue and implements the data relocation method again.
 13. The storagesystem according to claim 11, adapted to perform further processes of:an access relevance degree ranking process of assigning an accessrelevance degree to each data item of the data items; wherein the datamigrating process migrates data items of the one or more data items,beginning from an upper rank of access relevance degree of the dataitems.
 14. The storage system according to claim 11, adapted to performfurther processes of: a data item sizing process of determining a sizeof each data item of the data items; wherein the data migrating processmigrates data items of the one or more data items, according to sizes ofthe data items.
 15. The storage system according to claim 11, adapted toperform further processes of: an access-type determining process ofdetermining whether an access of a data item is a read-type access or awrite-type access; wherein the data migrating process migrates dataitems of the one or more data items, only for data items concerning thewrite-type access.